A Combination of Decision Trees and Instance-Based Learning Master’s Scholarly Paper

نویسنده

  • Peter Fontana
چکیده

People are interested in developing a machine learning algorithm that works well in all situations. I proposed and studied a machine learning algorithm that combines two widely used algorithms: decision trees and instance-based learning. I combine these algorithms by using the decision trees to determine the relevant attributes and then running the noise-resistant instancebased learning algorithm with only the attributes used in the decision tree. After using decision tree algorithms and instance-based learning algorithms from WEKA and data from the UCI Machine Learning Repository to test the combined algorithm, I concluded that this combination of the two algorithms did not produce a better algorithm. [3,6,9] My belief for this is that the attributes that one algorithm feels are relevant are likely different from the attributes that the other algorithm feels is relevant.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

IRDDS: Instance reduction based on Distance-based decision surface

In instance-based learning, a training set is given to a classifier for classifying new instances. In practice, not all information in the training set is useful for classifiers. Therefore, it is convenient to discard irrelevant instances from the training set. This process is known as instance reduction, which is an important task for classifiers since through this process the time for classif...

متن کامل

Solving multiple-instance and multiple-part learning problems with decision trees and decision rules. Application to the mutagenesis problem

In recent work, Dietterich et al. (1997) have presented the problem of supervised multiple-instance learning and how to solve it by building axis-parallel rectangles. This problem is encountered in contexts where an object may have different possible alternative configurations, each of which is described by a vector. This paper introduces the multiplepart problem, which is more general than the...

متن کامل

3D motion analysis based on machine learning in agriculture informatisation

in this paper, a motion retrieval system is investigated from a multiple-instance learning view. To retrieve similar motion data, each human joint’s motion clip is regarded as a bag, while each of its segments is regarded as an instance. First 3D temporal-spatial features and their keyspaces of each human joint are extracted. Then, data driven decision trees based on ensemble multiple instance ...

متن کامل

Discretization of Continuous-valued Attributes and Instance-based Learning

Recent work on discretization of continuous-valued attributes in learning decision trees has produced some positive results. This paper adopts the idea of discretization of continuous-valued attributes and applies it to instance-based learning (Aha, 1990; Aha, Kibler & Albert, 1991). Our experiments have shown that instance-based learning (IBL) usually performs well in continuous-valued attribu...

متن کامل

A Case Study in Machine Learning

Empirical machine learning develops methods for formulating predictive theories from observations, drawing on ideas from arti cial intelligence and statistics. This paper discusses examples of such methods in the context of modelling the biomedical activity of a family of compounds. Five approaches are compared: standard multivariate linear regression, piecewise linear models expressed as model...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008